Package-level declarations
Types
Link copied to clipboard
Link copied to clipboard
Expose a RagService as tools. Once the tools instance is created, options such as similarity cutoff are immutable and will be used consistently in all calls. The LLM needs to provide only the search query.
Link copied to clipboard
data class RagOptions constructor(val ragService: RagService, val similarityThreshold: <Error class: unknown class> = 0.7, val topK: Int = 8, val hyDE: HyDE? = null, val desiredMaxLatency: Duration = Duration.ofMillis(5000), val compressionConfig: CompressionConfig = CompressionConfig(), val llm: <Error class: unknown class> = LlmOptions.withAutoLlm(), val contentElementSearch: ContentElementSearch = ContentElementSearch.CHUNKS_ONLY, val entitySearch: EntitySearch? = null, val ragResponseFormatter: RagResponseFormatter = SimpleRagResponseFormatter, val dualShot: DualShotConfig? = null) : RagRequestRefinement<RagOptions>
Operations for RAG use as an LLM tool. Options are immutable and stable.
Link copied to clipboard
class RagReference(val name: String, val description: String, val options: RagOptions, summarizerPromptRunner: PromptRunner) : LlmReference
Expose a RagService as an LlmReference with tools.
Link copied to clipboard
Expose a RagService as tools. Once the tools instance is created, options such as similarity cutoff are immutable and will be used consistently in all calls. The LLM needs to provide only the search query.